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@ Interactive image modification. 

S) Apparatus for Interactively modifying an image rep- 
resented by digital data defining the colour component content 
of pixels of the Image, comprises an image store {2) for storing 
the said digital data: a display (7) ; look-up tables (8) defining 
retouch curves for each colour component; and a microproces- 
sor (3) for applying the image in the image store (2) to the LUTs 
(8) and thereafter to the display (7) to display the retouched 
image. The microprocessor also enables an- operator to modify 
the retouch cun/es so that a second selected image point is 
retouched to the colour of a first selected image point by 
modifying a colour component retouch cun/e for each colour 
component used to define the original Image such that a pixel 
located at the second selected point will be retouched to have 
the colour content of a pixel at the first selected point. 
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Description 

INTERACTIVE 

The invention relates to a method of interactively 
modifying an image. 

It is common practice, in preparing an image such 
as a picture for printing to modify a digital represen- 
tation of the image by adjusting the colours of pixels 
of the image. Typically, this Is achieved by loading 
respective look-up tables with data defining retouch 
curves for each colour component. Subsequently, 
the original digital data is used to address the 
look-up tables which generate modified or retouch 
data. 

in the past, colour retouching has been achieved 
by displaying on a monitor screen graphs represent- 
ing colour component retouch curves for each 
colour component. The form of these curve's is then 
modified. After the modification, the original image is 
redisplayed under the control of the modified 
retouch curves to allow the effects of the modifica- 
tion to be viewed. This suffers from the disadvantage 
that it requires considerable experience on the part 
of an operator to know the effect of the modifica- 
tions to the retouch curves he is making since 
othenvise he will have to wait for the redisplay of the 
image after each modification to see the result of the 
modifications. 

In accordance with one aspect of the present 
invention, a method of interactively modifying an 
image represented by digital data defining the colour 
component content of pixels of the image comprises 

i) displaying a representation of the image on a 
monitor; 

ji) selecting first and second points on the 
displayed image; and 

iii) modifying a colour component retouch curve 
for each colour component used to define the 
original image such that a pixel located at the 
second selected point will be retouched to have the 
colour content of a pixel at the first selected point. 

In accordance with a second aspect of the 
present invention, apparatus for interactively mod- 
ifying an Image represented by digital data defining 
the colour component content of pixels of the image, 
comprises an image store for storing the said digital 
data; a display; retouching means defining retouch 
curves for each colour component; and control 
means for applying the image in the image store to 
the retouching means and thereafter to the display 
to display the retouched image and for modifying the 
retouch curves and is characterised in that the 
control means modifies the retouch cun/es so that a 
second selected image point is retouched to the 
colour of a first selected image point by modifying a 
colour component retouch cQrye for each colour 
component used to define the original Image such 
that a pixel located at the second selected point will 
be retouched to have the colour content of a pixel at 
the first selected point. 

Thus, instead of directly modifying colour compo- 
nent retouch curves, as has been done In the past, 
this is achieved automatically simply by selecting the 
required colour from another point of the image. It 
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should be understood that in practice the second 
point will not be retouched to exactly the same 
5 colour as the first but as near to it as the form of the 
retouch curves permit. 

The retouch curves will generally be stored in 
look-up tables. 
Typically, the method will comprise a preliminary 
10 step of storing initial colour component retouch 
curves in respective look-up tables, the content of 
the look-up tables being modified in step ill). 

The invention is applicable both to the interactive 
retouching of monochrome images and coloured 
15 images. 

In general, the area of an image to be retouched 
will be predefined by using a mask which can either 
be a simple geometric shape, an airbrushed shape, 
or a bit-mask such as a colour-sensitive mask or a 
20 text image. 

Preferably, the method further comprises select- 
ing at least one further pair of first and second points 
on the image; and repeating step iii) with each pair of 
points whereby the colour component retouch 
25 curves for each colour component are modified 
such that pixels with the colour content of one of 
each pair of points are retouched to have the colour 
content of the other of the pair of points while 
maintaining the retouching of the previously defined 
30 pairs of points substantially unchanged. Thus, after 
an initial modification of the retouch curves, these 
curves may be further retouched by defining further 
points. In general the points of each pair will differ 
from those of each other pair although in some 
35 cases some points could be common to two or more 
pairs. 

Preferably, after each step iii) the curves are 
Interpolated between the selected points in a 
conventional manner. This may cause some variation 
40 in the previously defined retouching operations 
where the form of the curves is constrained to one of 
a number of predetermined smooth shapes. 

Since the calculation of retouch curves can be 
carried out very quickly it is feasible to modify the 
45 retouch curves interactively as the operator moves 
an indicator, such as a cursor, across the displayed 
image. Thus, the operator wijl select a point on the 
image, and then move the cursor over other areas. 
While this Is being done, the ounces will be 
50 continuously updated, so that the selected point is 
retouched to the colour of the point currently under 
the cursor. 

An example of an apparatus and a method in 
accordance with the present invention will now be 
55 described with reference to the accompanying 
drawings, in which :- 

Figure 1 is a block diagram of the apparatus; 
Figures 2A-2D illustrate respective colour 
component retouch curves ; 
SO Figure 3 illustrates a further example of a 

retouch curve; 

Figures 4A-4C illustrate examples of high- 
light, midtone and shadow retouch curves; and 



Figure 5 is a flow diagram illustrating oper- 
ation of the apparatus. 
The apparatus shown in Figure 1 comprises a disc 
store 1 for storing original images in digital form. 
Each pixel In an image is defined by four sets of 
digital data defining the colour content of respective 
colour components of that pixel, typically cyan, 
magenta, yellow, and black. The selected image is 
loaded into an image store 2 under the control of the 
microcomputer 3. (Step 100, Figure 5) The micro- 
computer 3 is controlled by an indicator assembly 4 
typically comprising a digitising table 5 and cursor 
member 6. The image in the store 2 is then displayed 
on a monitor screen 10 of a monitor 7 (step 102) 
under the control of a microcomputer 3, the digital 
data from the store 2 being passed via a transform 
generator 8 to a transform store 9 defining the 
monitor screen pixels on a one to one basis. 

The transform generator 8 comprises a number of 
one-dimensional look-up tables (LUTs) four of which 
define colour component retouch curves. Other 
LUTs in the transform generator 8 convert the 
incoming colour component signals to monitor 
format colour component signals such as red, 
green, and blue in a conventional manner (See, for 
example EP-A-01 88098). 

Initially, the four colour component retouch LUTs 
are loaded (step 101) with a first set of curves which 
in the simplest case define the output signal to be 
equal to the Input signal. These curves are Illustrated 
in Figures 2A-2D respectively with the initial fonn of 
the curves indicated by the solid lines 11, In each 
case, the vertiai axis indicates the input signal in 
terms of percentage half-tone dot size while the 
horizontal axis indicates the output signal in terms of 
percentage half-tone dot size. 

The operator views the Initially displayed image 
which will correspond to the Image in the store 2 on 
the monitor screen 10. If he wishes to retouch a 
small area of the image,, he defines that area in a 
conventional manner (step 103) by for example 
generating a mask around the area. He can then 
indicate to the microcomputer 3 using a digitising 
table 5 the colour which he desires the masked area 
to take by moving a cursor on the screen to indicate 
another area of the image displayed (step 104). The 
microcomputer 3 will then determine the colour 
content of the pixel located at this second selected 
position and will then modify each colour component 
retouch curve accordingly (step 105). 

For example, If the cyan colour component of the 
second selected point has a value 40 then the 
microcomputer 3 will determine that a pixel within 
the masked region, where the cyan colour compo- 
nent may be 50 should be retouched to the value 40 
and this defines a point 12C which must \\& on the- 
cyan retouch cun/e. Having located the point 12C, 
the microcomputer 3 then interpolates a new cyan 
retouch curve In a conventional manner as indicated 
by a dashed line t3C In Figure 2A. In a slmilartnanner 
points 12M, 12Y. and 12B are defined, for the 
magenta, yellow, and black colour components 
respectively and new curves 13M, 13Y. and 13B are 
Interpolated. An example of an interpolation method 
is shown in US-A-3893166. 



This process can be repeated for a second area to 
be retouched which again 1s masked to define the 
area and a second point in the image selected which 
has a colour of the form to which the masked area is 
5 to: be retouched. Once again, a new point 14C is 
derived for the cyan colour component and a new 
curve 15C interpolated which passes^ through both 
the points 14C and 12C. In a similar manner the 
retouch curves for the other colour components are 
10 also modified. 

After all the modifications have been completed, 
the look-up tables are addressed by the data In the 
image store 2 and the resultant transformed pixel 
data is stored in the transform store 9 and used to 
IS control the display on the monitor 10. If the 
modification is found to be satisfactory, the micro- 
computer 3 is then used to modify the original digital 
data in the Image store 2. 
The method described above can suffer from 
20 some disadvantages since in certain cases it may be 
that a particular colour component value will be 
determined to have two different new values in 
different areas of the Image. Secondly, the re- 
quested changes may produce undesirable shapes 
25 for the retouch curves, for example causing the 
cun/es to "fold back" on themselves. 

A way of preventing these problems is to generate 
a final curve from combinations of other shapes 
which have been predetermined. These other 
30 shapes may comprise a family of - curve shapes 
dependent on a single parameter and a selection 
may be made from these to achieve a "best fit" for all 
the desired retouch changes. Thus, when the 
' desired retouch changes are entiered, they are 
35 stored in a table and then the retouch parameters 
are Iteratively modified by the computer to obtain the 
best fit to the desired retouch changes. In this 
context, "best fit" would mean the smallest value of 
the sum of the squares of the difference between the 
40 desired retouch value and the generated value, ie a 
"least-squares" method. This then leads to the 
generation of smooth retouch curves and avoids the 
possibility of curves which fold back on themselves. 
A more detailed example of an interpolation 
45 method will now be described. Figure 3 illustrates a 
typical colour component curve similar to any of 
Figures 2A-2D in which it Is desired to change a I00/0 
dot to a 1 20/0 dot and a 30o/o dot to a 280/o dot. The 
final curve is shown by a line 20 in Figure 3. In this 
50 case, the degree of modification is controlled by 
making, use of a family of retouch curves dependent 
on the three parameters HL. MT, SH (highlight, 
midtone, and shadow respectively). The values of 
these parameters are the amount of boost (positive 
55 or negative) at 16 2/30/o. 500/o and 83 I/30/0 
respectively. 
These curves are defined as follows: 

Highlight 

60 Letting y =» (50-o/odot) 733.333 (for 0^ o/odot < 
50) ARet-HL(x) = HL * (3y2 - 2y3). where HL is the 
boQist at 16:667 o/odot. 
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Midtone 

Letting y = 1 - 500/0 - o/odot|/33.333 (for 33.333 ^ 
66.667) = 0 otherwise 

ARet_SH(x) = MT * (3y2 - 2y3). where MT is the 
boost at 50 o/odot, 5 

Shadow tone 

Letting y = (O/odot - 60)/33,333 (for 50 ^ o/odot 
< 100) « 0 otherwise 

ARe1_SH(x)= SH * (3y2 -2y3). where SH is the 10 
boost at 83.333 o/odot. 

The retouch operation picks the best values of HL, 
MT and SH which generate a combined retouch 
cun/e passing through, or close to, the required 
points. First, the dependence on HL, MT and SH at IS 
the particular sample values is calculated. Then the 
final position of the retouched point is calculated 
according to the formula: 
ReL-HL/MT/SH(x) = x + ARet_HL(x) + 
ARet_MT(x) + ARet_SH(x) 20 

At 100/0 dot, the ARet MT and ARet SH are both 
zero, so the final retouch curve only depends on the 
value of HL. Substituting lOO/o into the equation 
given above gives ARet HL (10) = HL * {3y2 - 2y3). 

Thus the total retouch at this point: 25 
Ret HL(MT/SH(10)) = 10 + 0.864 * HL. 

Similarly, finding the dependence of the retouch 
curve at 300/o dot, gives Ret HL/MT/SH (30) = 30 + 
0.648 HL + 0.352 MT. 

The desired solution is: 30 
Ret-HL/MT/SH(10) = 12 
Ret-HL/MT/SH(30) = 28 
These become respectively: 
10 + 0.864 HL = 12 

30 4- 0.648 HL + 0.352 MT = 28 35 

This example can be solved algebraically, giving: 

HL « 2.3148 and MT « 9.9432. 

This can be extended, to further points if required. 

It should be recognised that this example has an 
algebraic answer. In general a "least squares" or 40 
other approximation will be required. This will mean 
that the final curve does not necessarily go through 
any of the desired points, which is not necessarily a 
problem, as a smooth curve is desired. In any event, 
if the points are sampled from the image, It is 45 
possible to get inconsistent requests, eg. both 
100/0— 1.120/0 in one place, and lOO/o— «^80/o in 
another. 

50 

Claims 



1. A method of interactively modifying an 55 
image represented by digital data defining the 
colour component content of pixels of the 
image, the method comprising 

1) displaying a representation of. the 
image on a monitor; 60 

ii) selecting first and second points on 
the displayed image; and 

iii) modifying a colour component re- 
touch curve for each colour component 
used to define the original image such that 65 



a pixel located at the second selected 
point will be retouched to have the colour 
content of a pixel at the first selected point. 

2. A method according to claim 1 , further 
comprising a preliminary step of storing 
initial colour component retouch curves in 
respective look-up tables, the content of 
the look-up tables being modified in step 
iii). 

3. A method according to claim 1 or 
claim 2, further comprising selecting at 
least one further pair of first and second 
points on the image; and repeating step iii) 
with each pair of points whereby the colour 
component retouch curves for each colour 
component are modified such that pixels 
with the colour content of one of each pair 
of points are retouched to have the colour 
content of the other of the pair of points 
while maintaining the retouching of the 
previously defined pairs of points substan- 
tially unchanged. 

4. A method according to any of the 
preceding claims, wherein after each step 
iii) the curves are interpolated between the 
selected points in a conventional manner. 

5. Apparatus for interactively modifying 
an image represented by digital data 
defining the colour component content of 
pixels of the image, the apparatus compris- 
ing an image store (2) for storing the said 
digital data; a display (7); retouching 
means (8) defining retouch curves for each 
colour component; and control means 
(3,4) for applying the image in the image 
store (2) to the retouching means (8) and 
thereafter to the display to display the 
retouched image and for modifying the 
retouch curves characterised in that the 
control means (3,4) modifies the retouch 
curves so that a second selected image 
point is retouched to the colour of a first 
selected image point by modifying a colour 
component retouch curve for each colour 
component used to define the original 
image such that a pixel located at the 
second selected point will be retouched to 
have the colour content of a pixel at the 
first selected point. 

8. Apparatus according to claim 5, 
wherein the retouching means comprises a 
set of look-up tables. 
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